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Abstract 

We consider a collection of Curie- Weiss (CW) spin systems, possibly 
with a random field, each of which is placed along the positions of a 
one-dimensional chain. The CW systems are coupled together by a 
Kac-type interaction in the longitudinal direction of the chain and by 
an infinite range interaction in the direction transverse to the chain. 
Our motivations for studying this model come from recent findings in 
the theory of error correcting codes based on spatially coupled graphs. 
We find that, although much simpler than the codes, the model stud- 
ied here already displays similar behaviors. We are interested in the 
van der Waals curve in a regime where the size of each Curie- Weiss 
model tends to infinity, and the length of the chain and range of the 
Kac interaction are large but finite. Below the critical temperature, 
and with appropriate boundary conditions, there appears a series of 
equilibrium states representing kink-like interfaces between the two 
equilibrium states of the individual system. The van der Waals curve 
oscillates periodically around the Maxwell plateau. These oscillations 
have a period inversely proportional to the chain length and an am- 
plitude exponentially small in the range of the interaction; in other 
words the spinodal points of the chain model lie exponentially close 
to the phase transition threshold. The amplitude of the oscillations 
is closely related to a Peierls-Nabarro free energy barrier for the mo- 
tion of the kink along the chain. Analogies to similar phenomena and 
their possible algorithmic significance for graphical models of interest 
in coding theory and theoretical computer science are pointed out. 
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1 Introduction 



Low-Density Parity-Check (LDPC) codes [T] are a class of parity check codes 
designed from appropriate ensembles of sparse random graphs. These have 
emerged as fundamental building blocks of modern error correcting schemes 
for communication over noisy channels. Their great advantage is the exis- 
tence of efficient, low complexity, decoding algorithms. It is quite remarkable 
that these systems can be viewed as mean field spin glasses on random sparse 
graphs. This connection has been known for some years and it is recognized 
that it is quite far reaching. The noise thresholds for the transition be- 
tween reliable and unreliable communication are obtained by a performance 
curv^ analogous to a van der Waals isotherm. Analogs of spinodal points 
determine thresholds - called Belief Propagation thresholds - under the effi- 
cient low complexity Belief Propagation decoding algorithm. The first order 
phase transition threshold - called Maximum a Posteriori threshold - can be 
obtained by a Maxwell construction and determines the threshold associated 
to optimal but computationally impractical decoding. We refer to [T] and 
[2] for further information and background on both the coding theory and 
statistical mechanics aspects. 

In order to design good codes one may try to design sparse graph ensem- 
bles such that the spinodal points are separated from the Maxwell plateau 
by a small gap. It has been realized recently [5], [S] that this goal can 
be achieved - in a versatile way - by a class of so-called convolutional ter- 
minated LDPC codes, which were first introduced in the early works [6], [7], 
[8]. They can be viewed as chains of individual LDPC codes of length n, 
that are coupled, along a one- dimensional spatial direction of length 2L + 1, 
across a coupling window of size w covering many individual codes. In the 
regime where n » L » w » 1 and with appropriate boundary condi- 
tions at the ends of the chain, the performance of the Belief Propagation 
decoder is excellent. In particular the Belief Propagation threshold improves 
and saturates towards the Maximum a Posteriori threshold, which is the best 
possible value. In statistical mechanical parlance the spinodal points come 
infinitely close to the Maxwell plateau. It has also been observed that the 
performance curve of the spatially coupled code ensemble displays a fine os- 
cillating structure, with oscillations of period 0(1/ L) as the Maxwell plateau 
is approached. In the coding theoretic context these observations go under 
the name of threshold saturation phenomenon. 

In order to better understand the fundamental origins of threshold sat- 
uration we have investigated a wide variety of models that are chains of 

^called Extended Belief Propagation Generalized Extrinsic Information Transfer curve 
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spatially coupled mean field systems, with appropriate boundary conditions. 
These include chains of Curie- Weiss models, random constraint satisfaction 
problems such as i^-SAT, Q-coloring and we have found that it is a very gen- 
eral phenomenon. See [9] for a short summary and the conclusion for further 
discussions of these aspects. It has also been shown to occur in various other 
settings such as muti-user communication and compressed sensing (see for 
example pTO], [II], [12], [13]). 

In the present work we present in detail what we believe is the simplest 
and clearest situation that captures the basic underpinnings of threshold sat- 
uration. We introduce a one dimensional chain of 2L + 1 Curie- Weis^ (CW) 
spin systems coupled together by an interaction which is local in the lon- 
gitudinal (or chain) direction and infinite range in the transverse direction. 
The local interaction is of Kac type with an increasing range and inversely 
decreasing intensity, and is ferromagnetic. This model can be viewed as 
an anisotropic Ising system with a Kac interaction along one longitudinal 
direction and a Curie- Weiss infinite range interaction along the "infinite di- 
mensional" transverse direction. We also analyze a variant of this model, 
where the individual system is a Random Field Curie- Weiss (RFCW) model. 

The main focus of this paper is to understand the evolution of the van der 
Waals isotherm of the coupled chain when the individual underlying system is 
infinite and, the range w of the Kac interaction and the longitudinal length 
2L + 1 become large L >> >> 1 but are still finite. This problem is 
studied for temperatures below the critical temperature of the individual 
system. The magnetizations at the boundaries are set equal to the two 
equilibrium states of the individual systemH. In the limit where both L and 
w become infinite the van der Waals isotherm of the coupled chain tends to 
the Maxwe// isotherm of the individual CW system. In particular the spinodal 
points of the coupled chain approach the Maxwell plateau of the individual 
system: this is the threshold saturation phenomenon. Correspondingly the 
canonical free energy of the coupled chain is given by the convex envelope of 
the individual CW model. When L and w are large but remain finite, below 
the critical point of the CW model, a fine structure develops around the 
Maxwell plateau: the straight line is replaced by an oscillatory curve with 
period of the order of the inverse chain length and amplitude exponentially 
small in the range of the Kac interaction (see fig. [U and formulas (155|1 . 
(158|) ). Correspondingly, the finite-size corrections to the canonical free energy 
display, in addition to a "surface tension" shift, the same oscillations along 

^Ising model on a complete graph 

^This is the right analogy with the coding theory context. Other choices are not relevant 
to the threshold saturation phenomenon. 



3 



the line joining the two equihbrium states of the individual system (see fig. 
[Hand formula flS51) ). The series of stable minima is in correspondence with 
kink-like magnetization density profiles, representing the coexistence of the 
two stable phases of the individual system, with a well localized interface 
centered at successive positions of the chain (formulas (l45l) . (1571) . and fig. 
Hj). A series of unstable maxima is associated with kinks centered in-between 
successive positions. The amplitude of the oscillations can be interpreted 
as a Peierls-Nabarro free energy barrier for the motion of a kink along the 
chain. We point out that although our analytical results are for the regime of 
large numerically we very clearly observe the same phenomena even when 
w = 1 which corresponds to nearest neighbored coupling between individual 
CW systems (section E]). 

One of the virtues of the present simple model is that it can, to a large 
extent, be treated analytically by rather explicit methods. While our analysis 
is not entirely rigorous, we believe that it can be made so. We have refrained 
to do so here, in order that the mathematical technicalities do not obscure 
the main picture. 




Figure 1: Qualitative illustration of main result. Dotted curves: free energy and 
van der Waals isotherm of the single system for a coupling strength J > 1 ( J = 1 
is the critical point). Continuous curves: free energy and van der Waals isotherm 
of the coupled chain for 2L >> w » 1. The oscillations extend throughout the 

plateau with a period A//2L and amplitudes 0{L~'^e jm ) (left) and 0{e jm ) 
(right) where M = width of plateau, a = 0(1) depends on the details of the 
interaction (sect. [3|). Close to the end points of the plateau, within a distance 
0(L~^/^), boundary effects are important and the curves depend on details of the 
boundary conditions (sect. [5]). 

In view of the classical work of Lebowitz and Penrose [H] it is perhaps 
not surprising that the van der Waals curve of the chain tends to the Maxwell 
isotherm. However there is a difference: in [H] their "reference system" has 
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a short range potential whereas here the individual CW system has infinite 
range interaction. Therefore in [T3] the sequence of infinite volume canonical 
free energies remains convex during the Kac limiting process. This is not the 
case in our setting (below the critical point). Similarly, the present limit is not 
equivalent to anisotropic Kac limits. Again, during such limiting processes 
the sequence of infinite volume free energies remains convex whereas in the 
present model the convergence proceeds through oscillatory curves of ever 
smaller amplitude. We are not aware if anisotropic Kac limits have been 
discussed in the literature and we make these remarks more precise in section 

El 

There is a large literature on models involving a mixture of infinite range 
(mean field) and short range interactions; we point to [U], [TB] for the inter- 
ested reader. Here we wish to point out a few works that are more specifically 
related to the present model. Falk and Ruijgrok introduced a chain of spin 
systems where every spin interacts only with all spins of the neighboring 
chains [17]. The model and mean field equations of this model appear to 
be similar to ours [T7], [TS]; but one crucial difference comes from the fact 
that there are no intra-chain interactions in their model, and thus the indi- 
vidual system has a trivial isotherm^. A mean field approximation, related 
to our model, has been used to analyze the phase diagram of the two and 
three dimensional Axial Next Nearest Neighbor Interaction (ANNNI) Ising 
model [in], [SO]- The motivation there was completely different than ours 
and was focused on the existence of incommensurate phases. In [2T] sta- 
tionary nonequilibrium states of the van Beijeren-Schulman model [22] of a 
stochastic lattice g studied. These are controlled by a "free energy 

functional" that bears structural similarities with the present equilibrium 
model for w = 1. Another relation is with the works of [23], [21], [23] on the 
coexistence of two phases in a strictly one dimensional Ising model with Kac 
interaction. Static as well as dynamical aspects have been studied and in 
appropriate hydrodynamic limits the magnetization density satisfies a mean 
field equation which is (at least for Glauber dynamics) a continuous version 
of the discrete mean field equation derived here for the chain model. 

In section [2] we set up our basic model and give a formal solution. The 
asymptotic analysis for L » w » 1 is performed in section [3] and this is 
supplemented by numerical simulations valid for all w in section [51 Section HI 
contains a generalization to a model with random fields. Section |6l discusses 
the differences with anisotropic Kac limits and in [7] we point out further 
analogies with error correcting codes and models of constraint satisfaction 

■*Tlie model was introduced with different motivations in mind. Namely to establish 
how the critical temperature "deteriorates" as the length of the chain grows. 
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problems. 



2 Chain of Ising systems on complete graphs 
2.1 Curie- Weiss model 

We start with a brief review of standard material about the Curie- Weiss 
model (CW) in the canonical ensemble (or lattice-gas interpretation) which 
is the natural setting for our purpose. The Hamiltonian is 



where the spins Sj = ±1 are attached to the vertices of a complete graph. 
In dl]) the sum over carries over all edges of the graph and we take a fer- 
romagnetic coupling J > 0. In the sequel we absorb the inverse temperature 
in this parameter. The free energy, for a fixed magnetization m = YliLi 
is 

$7v(m) = --InZ^v, Zn= ^ e"^^ (2) 

It has a well defined thermodynamic limit (we drop an irrelevant additive 
constant) 

lim $Ar(m) = $(m) = — 'H(m) (3) 

N^+oc 2 

equal to the internal energy —^m^ minus the binary entropy, 

l + m,l + m 1— m,l— m 

nim) = — 

of configurations with total magnetization m. In the canonical formalism the 
equation of state is simply 

(9$(m) ^ 1, 1 + m , , 

/i= — ^ = -Jm + -ln- , 5 

am 2 1 — m 

which is equivalent to the Curie- Weiss mean field equation 

m = tanh( Jm + /i). (6) 

As is well known, from the van der Waals curve h{m) (E]), one can derive 
an equation of state that satisfies thermodynamic stability requirements from 
a Maxwell construction. Similarly a physical free energy is given by the 
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Figure 2: Left: van der Waals curve in the high temperature phase J < 1. 
Right: low temperature phase J > 1. For m ^ {m^,m^) the curve describes 
stable equilibrium states and for m G (m_, —msp) U (?nsp,m+) metastable states. 
For m G {—msp, msp) the system is unstable. The Maxwell plateau describes 
superpositions of m_ and m+ states. 

convex envelope of ([3]). For J < 1, h{m) is monotone (see fig. 12. ip and the 
inverse relation m{h) yields the thermodynamic equilibrium magnetization 
at a given external magnetic field. For J > 1 ([5])-(|6]) may have more than 
one solution for a given h (see fig. 12. ip . Starting with h positive and large, 
we follow a branch mj^{h) corresponding to a thermodynamic equilibrium 
state till the point {h = 0+, m = m+). Then we follow a lobe corresponding 
to a metastable state till the spinodal point {h = —hsp, m = msp) at the 
minimum of the lobe. Finally from the spinodal point to the origin the 
curve corresponds to an unstable state (where ^ < 0). The situation is 
symmetric if we start on the other side of the curve with h large negative. 
We first follow a stable equilibrium state with magnetization equal to m^{h) 
till the point [h = 0_,m = m_); we then follow a metastable state till the 
left spinodal point [h = hsp,m = — m^p); and finally an unstable state till 
the origin. 

The following expressions valid for J > 1, will be useful in the sequel, 



In these formulas ~ means that 7—7-1+. The first order phase transition line 
is {he = 0, J > 1) and terminates at the critical second order phase transition 
point {he = 0, J = 1+). For J < 1 and h = 0, m± = 0. We will see that for 
the chain models the difference between the first order phase transition and 
spinodal thresholds becomes much smaller, and in fact vanishes exponentially 
fast with the width of the coupling along the chain. 




(7) 



and 



m± ^ ±v/3(J- 1). 



8 



7 



2.2 Chain Curie- Weiss model 

Consider 2L + 1 integer positions z = —L, +L on a one dimensional line. 
At each position we attach a single CW spin system. The spins of each 
system are labeled as Siz, i = 1, N, and are subjected to a magnetic field 
h. The spin-spin coupling is given by 



where the function (^dxl) satisfies the following requirements: 

a) It takes non-negative values and is independent of i,j and L. It may 
depend on w itself (see comments below) however we still write g{\x\) instead 
of gU\x\). 

b) Has finite support [— 1,+1], i.e g{\x\) = for > 1. 

c) It satisfies the normalization condition 



This is a purely ferromagnetic interaction which is of Kac type in the one 
dimensional z direction and is purely mean field in the transverse "infinite 
dimensional" direction. Condition a) ensures that we can find asymptoti- 
cally (as z — 7- ±oo) translation invariant states. Allowing for sign variations 
certainly leads to a richer phase diagram and is beyond the scope of this 
paper. Conditions b) and c) can easily be weakened without changing the 
main results at the expense of a slightly more technical analysis. One could 
allow for functions that have infinite support and decay fast enough (with 
finite second moment) at infinity. The normalization condition is set up so 
that the strength of the total coupling of one spin to the rest of the system 
equals J as iV — )■ -|-oo (as in the individual CW system). For any given 
function ^(|x|) that is summable, we can always construct one that satisfies 
this condition f^dxl) = uig{\x\)/ '^'^^_^g{w~^\z\). This means that in gen- 
eral f^dxl) will depend explicitly on w; however we could relax this slight fine 
tuning by taking the normalization condition to hold only asymptotically as 
w — )■ -|-oo, namely that g{\x\) = 1. 
The Hamiltonian is 




(9) 




(10) 





(iz,jz') 
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The first sum carries over all pairs {iz,jz') (counted once each) with i,j = 
1, ...,N and z, z' = —L,...,L. We will adopt a canonical ensemble with 



N,L 

m 

,z=-L 



{2L + l)N 



fixed. The partition function Z^^l is defined by summing e"^^-^ over all spin 
configurations {siz = ±1, i = 1, N; z = —L, ...,L} satisfying (|T2|) . 

We now show that the free energy fpi^L = ~ n{2L+i) is given by a 

variational principle. Let us introduce a magnetization density at position z 



^z = ^^Siz, (13) 

i=l 

and a matrix 

Dz,z' = Jz,z' - J5z,z'- (14) 

This matrix is symmetric and for any z' = —L, +L it satisfies 

L 

Y Dz,z' < JKW ±L\ <w) (15) 

z=-L 

The important point here is that the row sum of ( !T4|) vanishes except for 
z' close to the boundaries. In this respect one may think of fll4p as one- 
dimensional Laplacian matrix and, as we will see, this becomes exactly the 
case in an appropriate continuum limit of the model. The Hamiltonian can 
be re-expressed as (up to a constant) 

Hn,l = -y 2^ Dz^z'mzmz' — (16) 

z,z'=—L z=—L 

In the thermodynamic limit the magnetization density becomes a continuous 
variable G [— 1,+1] and the partition sum becomes (up to irrelevant 
prefactors) 



[ Y\ druz 6({2L + l)m - V m^^ 

xexp-A^f-^ Dz,z'mzmz' + <l>{mz)j. (17) 
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This integral can be interpreted as the canonical partition function of a one 
dimensional chain of continuous compact spins G [—1, +1], at nearly zero 
temperature A^~^, with Hamiltonian 



2 

z,z'=-~L z=~L 

The free energy of the finite chain obtained from f fT7|) is 

Fi^{m) = - lim \-\i\Zj^i^= min ^^[{mj]. (19) 

The solutions of this variational problem satisfy the set of equations 

were A is a Lagrange multiplier associated to the constraint (and where $' 
denotes the derivative of the function $). Denote by (A*,m*) a solution of 
fl20|) for given m. The van der Waals equation of state is then given by the 
usual thermodynamic relation 

1 dF,(^) pi) 



2L + 1 dm 

In fact h = X*. Indeed, differentiating in fl^T]) thanks to the chain rule and 
then using (1201) yields, 



1 L . L 



// *^ 



z=~L ^ z'=-L ' 

A* rfm! 



2L + 1 ^ rfm 

z=—L 

= X* (22) 

Let us make a few remarks on alternative forms for the above equations. 
First, summing over z the first equation in (l20i) we obtain thanks to (fT5|) 

^=2ZTT ^ <J^'K) + 0(|) (23) 

2 = — L 
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Second, using the explicit expression for the potential $(m^), equation fl2D|) 
for the minimizing profiles can be cast in the form 



This is a generalization of the CW equation to the chain model. We discuss 
a continuum version of the equation in the next section. We also remark that 
this is the form of the equation which has a convenient generalization for the 
chain with random fields (see section H]). 

For J < 1 the single CW system has a unique equilibrium magnetization 
so we expect a unique translation invariant solution for , namely m* = m 
(neglecting boundary effect). It then follows that the van der Waals curve of 
the chain model is the same as that of the single CW model. On the other 
hand for J > 1 the solutions of (l20l) display non-trivial kink-like magneti- 
zation profiles. These solutions are responsible for an interesting oscillating 
structure in the van der Waals curve. This is investigated both numerically 
and to some extent analytically in the next two sections. 

Before closing this section we want to point out that the same system 
can be analyzed in the grand-canonical ensemble (always from the lattice 
gas perspective) by adding an external magnetic field term —hY2^^Siz to 
the Hamiltonian f|T6l) . The definition of the model is completed by imposing 
the boundary conditions: 



where m±{h) are the local minima of $(m) — hm. Note that when the 
minimum is unique (for J < 1 or J > 1 and \h\ > hgp) the two boundary 
conditions m±{h) are simply equal. The free energy (or minus the pressure 
of the lattice gas) is given by the variational problem 




m* = tanh{ Jm* + h + Z1^=-l -^2,2'"^^'}, 



(24) 




(25) 



i=l 



mm 

mz:m±L=m±{h) 




(26) 




(27) 




(28) 
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The solutions of fl7r|) or (^E^ define curves 'm*{h). Proving the existence of 
these curves is beyond our scope here; in general these are not single valued 
because the solutions are not unique for a given h. The van der Waals relation 
h{m) can be recovered from these curves by using 

1 ^ 

= ^lTi ^ ""^^^^ ^^^^ 

z=—L 

The magnetization profiles of the canonical and grand-canonical ensem- 
bles only differ near the boundaries. Their bulk behavior which is our interest 
are identical. In this paper this is verified numerically (section |5]). In the next 
section we find it more convenient to refer to the grand-canonical formalism 

(EB, (EHl). 

3 A continuum approximation 

The asymptotic limit ofL>>w>>l reduces the solution of equations flTTI) . 
(I28p . (1291) to a problem of Newtonian mechanics. In this limit we obtain a 
non-linear integral equation which cannot be solved exactly; but whose solu- 
tions can be qualitatively discussed for any fixed J > 1 (an exact solution for 
all J > 1 is provided in a special case). Near the critical point J — 1+ this 
equation is solved and the solutions used to compute an approximate version 
of the van der Waals curve. In this way all the features of the numerical so- 
lution are reproduced. Usually continuum limits are obtained when a lattice 
spacing a between neighboring sites of the chain is sent to zero. This set up 
can also be explored for the present model and one finds that it is non trivial 
only near the critical point J — 1+, where it yields qualitatively identical 
results to the limit w — )■ +oo, J 1+. Away from the critical point (J > 1) 
a — )■ is a trivial limit which supports only homogeneous states, contrary to 
the w — 7- +00 limit which displays non trivial features for all J > 1. 

Asymptotics for L >> w >> 1. We set 

z = wx, rriz = = /u(a^) (30) 
so equation (17?]) is equivalent to 

- E {9{\x--\)-w6^AJ-)=<^\f,{x))-h. (31) 
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We take the limits L +00 first and w — )■ +00 second, so that this equation 
becomes 




dx' {g{\x'\) — 5{x' 



+ x') = - h. 



(32) 



which can also be cast in a more elegant form (* denotes convolution) 



We cannot solve this equation in general, except for the special case of uni- 
form g. Equ. 033]) for /i = appears in [23], [21] and existence plus properties 
of solutions has been discussed. For our purpose a qualitative discussion of 
its solutions suffices and we briefiy outline it for the reader's convenience. 
For I a; I >> 1 we can expand fi{x + x') to second order (in (l32l) ) since g{\x\) 
vanishes for \x\ > 1. This yields the approximate equation 



We recognize here Newton's second law for a particle moving in the inverted 
potential — $(/i(a;)) where /i(x) is the particle's position at time x and Jk 
its mass. Note this is not a Cauchy problem with fixed initial position and 
velocity, but a boundary value problem with lim^.^-|-oo /^(2^) = ^±{h)\ the 
boundary conditions automatically fix the initial and final velocities. The 
nature of the solutions can be deduced by applying the conservation of me- 
chanical energy for a ball rolling in the inverted potential. For J < 1 the 
inverted potential has a single maximum at m^{h) = m-{h) and the only 
solution is /i(x) = m±{h), corresponding to a homogeneous state. In fact 
this is also true for the integral equation. Now we consider J > 1 and h = 0. 
At time —00 the particle is on the left maximum and starts rolling down 
infinitely slowly, then spends a finite time in the bottom of the potential 
well, and finally climbs to the right maximum infinitely slowly to reach it 
at time -|-oo. For the magnetization profile this translates to a kink-like 
state. Note that the center of the kink is set by the normalization condition 
fl29p . and thus we have a continuum of solutions parametrized by the param- 
eter m on the Maxwell plateau [m_,m+]. For J > 1 and h > 0, the particle 
starts with a positive initial velocity, rolls down the potential well, and finally 
reaches the right maximum infinitely slowly. Thus fi{x) = m^{h) for all x 
except for an interval of width 0(1) near the left boundary at minus infinity. 
This translates into an essentially constant magnetization profile with a fast 
transition layer near the left boundary, for J > 1 and h < the picture is 
similar. 



tanh.{Jg * fi + h) = fi. 



(33) 





(34) 
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These arguments imply that in a first approximation (L and w infinite) 
the van der Waals curve of the chain-CW system is given by the Maxwell 
construction of the single CW system. In order to get the finer structure 
around the Maxwell plateau we have to do a more careful finite size analysis. 

Asymptotics for L » w » 1 large and J — 1+. Now we set 

t 



t = VJ - Ix, /i(x) = /i( ) = VJ - Icrit) (35) 

y'J — 1 

and look at the regime J — )■ 1+. A straightforward calculation shows that 
the left hand side of equation fl5^ becomes 



J(J-1 



3 



2 

and that the right hand side becomes 



dxgi\x\)x'y"{t) + 0{{J - l)i), (36) 



(J - l)H-a{t) + \a{tf) - h + 0((J - l)t). (37) 



Lastly, we set h = h{J - l)"!, and thus from ([32]), ([36]), ([37]) 

Ka"{t) = -(T{t) + ^(r{tf - h. (38) 

Again, this is Newton's second law for a particle of mass k moving in the 
inverted potential 

V{a) = - ^a' + ha. (39) 

The boundary conditions (1271) mean that the initial and final positions of the 
particle for t — >■ ±cx) are the solutions of 

<y±-\<^l + h = 0, (40) 

corresponding to the local maxima of the potential. Initial and final velocities 
are automatically fixed by the requirement that lim^^-i-oo c"(^) = o"±- 
Summarizing, in the limit 

lim lim lim (41) 

J^l+;h(J-l)-i fixed '"^+°° ^^+°° 

the magnetization profile is 

^ VJ - la(VJ- 1-) (42) 
14 



where a{t) is a solution of 
Kink states. For h = (meaning h = 0) fl38|) has the well known solutions 

t-r' 



a^'^'^it) = Vstanh 



^2k 



(43) 



The center r of the kink is a parameter that we have to fix from the normal- 
ization condition. From fl42l) and fl43l) we have 



2L 



1 +^ 



v/3(7^ 



2L 



I — tanh(L 



z 



WT 



2 



wV2k L L^/J -I 

WT 



)) 



ax signi ( X 



wy2K 



LVJ^ 



)) 



(44) 



Since this sum must be equal to m we find r ~ The net result for the 
magnetization profile is 



'^-'^ - v/3(J-l)tanh<| -a/^I 

' w V 2k 



(45) 



Homogeneous states. When h ^ the solution cannot be put in closed 
form. To lowest order in h the solutions of (140 p are a± = ±V3 + h. The 
initial velocity is (assuming the final velocity is zero) to leading order, 



^-(VK)-V(._)).2^ 



(46) 



Thus, roughly speaking, the particle travels with constant velocity 2^^h^/'^ 



from position — + h during a finite time and then stays ex- 



ponentially close to the final position a/3 + ^. The magnetization profile 



IS 



r-v/3(J^+ ^ + ^(3(J- l))V4/,i/2(^), 



-L < z < -L + 0{ 



a/3(J-1) + 



h 



2(J-1)' 



.>-L + 0(,(^ 



l))l/4/jl/2 J 
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Comparison of free energies. In this paragraph we compute a naive 
approximation for the free energy flTI?]) . First consider the energy difference 
^kink _ ^const j^g^^gg^ kiuk m^"'^ and constant m^""*^* = m states both with 
total magnetization m_ < m < m+ on the Maxwell plateau. We write this 
as 

^kink _ ^const _ (FL{m±) - Ff"^*^*) + (F^'"'^ - ^^(mi)) (48) 

Because of (IT^ the first term is easily estimated as (2L+l)($(m-|-) — $(m)) + 
0{w) which is negative for m on the Maxwell plateau. Since the magnetiza- 
tion density of the kink state tends exponentially fast to ■m± for z — )■ ±00 
the second term is clearly 0{w) and therefore for L large the kink states are 
stablfl But our interest here is in a precise calculation of this second term 
which displays an interesting oscillatory structure. 



z,z'=-L 
L 

+ ($(mf ') - $ (m±)) 

z=-L 

Using f HSjl and f|T5|) it is easy to see that, in the bulk, f H9|) is a periodic 

function of m with period v_l^_Jl^ long as the center of the kink is in the 
bulk. To compute it we first extend the sums to infinity and use the Poisson 
summation formula 

r+oo 

^F(z) = 5^/ dze'-^'^F{z) (50) 



-00 



for 

+00 

F{z) = — J2 D.^.^mf'^^m^''^ - m|) + <l>{mf''^) - $(^3(7 - 1)) (51) 



A look at (145|) shows that it has poles in the complex plane at Zn 



mL 



^3(^-1) 

m{n + \)w ^J-^^, 77, G N. This suggests that the first term in fIFIl) has the 

same pole structure. The second term involving the potential is more subtle 
because its exact expression involves a logarithm which induces branch cuts. 
However one can show, keeping the true expression for the potential, that 

the branch cuts are outside of a strip |S(2;)| < f jzi, and therefore F{z) 



'this argument breaks down for |m — m± \ — 0(L 2 ); this is discussed in sect. [S] 
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is analytic in this strip. This is enough to deduce from standard Paley- 



Wiener theorems that for w^j^ large \F{k) \ = 0{e '^''"'v j-i^'" In the 

appendix we perform a detailed analysis to show (for J — > w large and k 
fixed) 



j^^ dz^^'^'F{z) ^ 4( J - l)Kw^T:^k{l - A;2^^) sinh"! (^t^^^oj^^^ 

(52) 

Retaining the dominant terms /c = and k = ±1 in the Poisson summation 
formula we find for the free energy (m_ < m < m+) 

F^'^^im) ^{2L + l)$(m±) + 4w{J - ^f^^ ^ 

- 16(7rw;)^fi:2e-"'"v^ cos ( 27im , ^ =^ (53) 

V V3(J-1); 

This result confirms the Maxwell construction, namely that the free energy 
per unit length converges to the convex envelope of $(m). The finite size 
corrections display an interesting structure. The first correction 0((J — 1)'^/^) 
comes from the zero mode and represents the "surface tension" of the kink 
interface. The oscillatory term is a special feature of coupled mean field 
models. As explained in more details in section [6l general arguments show 
that for an anisotropic Kac limit such a convergence to the Maxwell plateau 
would not occur through oscillations but through a sequence of convex curves. 
According to formula (1451) is the position of the kink, thus the profiles 

centered at integer positions correspond to minima of the periodic potential 
and are stable, while those centered at half-integer positions correspond to 
maxima and are therefore unstable states. The energy difference between a 
kink centered at an integer and one centered at a neighboring half-integer is 
a Peierls-Nabarro barrier 

32(7ru')V2e-"'"'^^. (54) 

This is the energy needed to displace the kink along the chain. Such energy 
barriers are usually derived within effective soliton like equations for the 
motion of defects in crystals [26]. Here the starting point was a microscopic 
statistical mechanics model. 

Oscillations of the van der Waals curve. The van der Waals curve is 
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easily obtained (m_ < m < m_|_) 



Q pkink / 

^ - ^ ^ ^^^'"^ ^ (m±)) (55) 




2L + 1 9m 
167r(7rw)^K^ 

At this point we note that the hmit L — )■ +oo and do not commute. 
This is so because on the Maxwell plateau we have a sequence of transi- 
tion^ from one kink state to another. In accordance with the numerical 
calculations, we find a curve that oscillates around the Maxwell plateau 

m E [-^3{J -1),+^3{J - 1)] with a period 0(^^-^^^). The amplitude 
of these oscillations is exponentially small with respect to w and thus much 
smaller than the height 0(( J — 1)'^/^) of the spinodal points (see ([7j)). For ex- 
ample for the uniform coupling function we have k = 1/6 and the amplitude 

of the oscillations is 0{e 



3(J-1) 



Uniform interaction: h = and all J. In case of a uniform interaction 
along the chain fi'dxl) = |, |x| < 1 and otherwise, it turns out that equation 
(15^ has the exact solution 

/i(x) = m± tanh Jm± (x — Xq) (56) 

for all /i = and J. This can be checked directly by inserting the function 
in (133|) and seeing that it reduces to the CW equation for m^. Of course 
this solution is non trivial only for J > 1. Relating the center Xq to the total 
magnetization we get the magnetization profile 

TTiz ~ mi tanh< [z L) > (57) 

w m± J 

Here ~ means that L >> w >> 1. One can check that the formula reduces to 
(H5|) when J — 1+. With this expression one can compute an exact formula 
for the exponent of the amplitude of oscillations of the van der Waals curve. 
Indeed as argued after (1511) this exponent is solely determined by the location 
of the poles of f l57|l for z E C. Therefore we obtain for the case of the uniform 
interaction and all J > 1, 

2 

h = C{w, J)e -^"i sin(27r L) (58) 

m± 



^these can be thought as first order phase transitions with infinitesimal jump diseonti- 
nuities 
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where C( J, w) is a prefactor that could in principle be computed by extending 
the calculation of the Appendix. Up to this prefactor, the Peierls-Nabarro 

barrier is e ■'"^+ for all J > 1. 

Remarks. The main features of these oscillations, their period and exponen- 
tially small amplitude, are independent of the details of the exact model and 
its free energy. Only the prefactor will depend on such details. The period 
is equal to "^'^2L^~ where m+ — m_ is the width of the Maxwell plateau. The 
wiggles have an amplitude e~^'^^ where A is the width of a strip in C where 
the kink profile is analytic (when the position variable z is continued to C). 
In general we have A = a ^J^^ were a = 0(1). For the uniform window 

a = 1 and in general when J — t- 1+ we have a — t- k"^/^. The point here is 
that the amplitude of the wiggles does not depend on the details of the free 
energy but only on the locations of the singularities m^™'^ in the complex 
plane. If an explicit formula is not available for the kink profiles A can still 
be estimated by numerically computing the discrete Fourier transform of the 
kink and identifying A with its rate of decay. This quantity will always be 
proportional to the scale factor w in m^™'^. 



4 Random field coupled Curie- Weiss system 

In this section we extend the problem to a chain of random field Curie- Weiss 
(RFCW) models. The analysis being similar we only give the main steps 
for the simplest such extension. We will adopt the canonical formulation. 
Consider again a chain of single RFCW systems attached to positions z = 
—L,...,+L. At each position we have a set of spins Siz, i = 1,...,N 
interacting through the coupling (Q and subject to a random magnetic field 
hiz- The r.v hiz are i.i.d with zero mean E[/ii2] = and for simplicity we 
assume that they take on a finite number of values P(/ij2 = Ha) = Pa where 
a runs over some finite index set. The Hamiltonian is 

^ N,L 

Hn,L = —J^ ^ Jz,z'SizSjz' — ^ hizSiz- (59) 
{iz,jz') i=l,z=—L 

The partition function involves a sum over all configurations satisfying the 
constraint '^^z=i -l ~ '^N{2L + 1). 

For each z = — L, +L we introduce the variables 

ruza = Tj—^ ^ Siz where Iza = {i I kz = H^}. (60) 
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In terms of these the magnetization profile becomes 

N 



i=l a 

and the Hamiltonian (up to a constant term) 

z,z'=~L z=—L z=—L a 

(62) 

When — )■ +00 typical realizations of the random field satisfy ^-^j^ — Pa 
and the Hamiltonian becomes deterministic. The partition function can be 
expressed as an integral analogous to f|T7|) , which yields for the canonical free 
energy 



Fl\m) = min <! > ' D.,_.,m.m., 



14 5: D'.'" 

^ z,z'=-L 

~ X] ^2""^^ ^ ^Pa{Ham^o^ + Him.a)) > (63) 

z=—L " 



As usual the van der Waals curve is given by the relation h = ^^^dFl^^{m) / dm. 
To carry out the minimization in (163|) we apply the gradient operator 



+ ^^-7^'^) (64) 



to the associated Lagrangian and equate to zero. This leads to the set of 
equations 



E:'=-LDz,z'm, = -Jm^ -\-H^ + \H^)^ ^11 



a 



m 



,+1 '^z=-L '^za- 



(65) 



2L+1 



Similarly to fl20l) . if (m*^, A*) is a solution, it can be shown that A* = h. 
Moreover multiplying (165 p by Pa and summing over z we obtain 

h = -Jm + E E - In f '-^^) + O(^) (66) 



This generalizes (l23il . 
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Finally we note that from fl^Sjl or working directly in a grand-canonical 
ensemble one can derive a generalized CW equation for the magnetization 
profile: 

L 

= J^p«tanh{ Jm^ + /i + iJo + ^ ^z,^'"^^'}- (67) 

a z'=—L 

The solutions m*,{h) of this equation yield still another representation for the 
van der Waals curve m = Y1!1=-l "^*(^)- 

In this case it is more difficult to analyze the continuum approximation 
and we rely on the numerical solutions of the next section. The picture which 
emerges is essentially the same as in the deterministic model. 



5 Numerical solutions 

We have carried out the numerical computations both for the equations in the 
canonical and grand-canonical formulations. These confirm the analytical 
predictions for the oscillations of the van der Waals curve. Near the end 
points of the Maxwell plateau the situation is not identical for the canonical 
and grand-canonical ensembles because boundary effects become important. 
For simplicity we start with the grand-canonical formulation. 

Grand-canonical equations. It is convenient to solve a slightly different 
system of equations than f l28|) in order to eliminate boundary effects (one 
may think of this as a modification of the model at the boundaries of the 
chain) 

= tanh{ Jm^ + h + Z1J=^l~L+i -D^.z'"!^'}, -L < z < +L 
mz=m+{h), L + 1 < z < L + w -1 (68) 
rriz = m^{h), —L — w + 1 < z < —L — 1. 

In other words, we force the profile to equal m^{h) at extra positions —L — 
If -|- 1 to —L — 1 and to m+{h) at extra positions L + ltoL + w — 1. The 
van der Waals relation h{m) is recovered from the solutions ml{h) of fl68|) 
by using fl29|) . The first equation is equivalent to 

L+w-l 

h = —{J + Dzz)mz + ta,nh.~^ rriz — Dzz'^riz' (69) 

z'=-L-w+l,z'^z 

Summing over z and using (l29i) we obtain 
h = -{J + Dzz)m+ ^Jtanh'^m,- J] Z^.^my I (70) 

z=~L ^ z'=-L-w+l,z'^z ^ 
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Also, (El]) is equivalent to 

L+w-l 

J + L'^,^ — 1) = tanli""*^ — rriz — Dz^z'^z'—h (71) 

The last two equations are the basis of: 

Algorithm 1 Iterative solutions of f l^S]) 

1: Fix m. Initialize mi*^"* = m for —L < z < L and h^^^ = 0. 
2: Prom mi*^ compute: 

I i f L+w—l V 

^ ( J + Dz,z)m + tanh-i - J] Z),,,mJ) 

2=-L z'=-L-w+l,z'^z ' 

3: For —L < z < +L, update mi*^"^^ as 



L+w-l 

(t+i) 



J + Dz.z - 1 



itanh-1 mW-?nW- J] i 

z'=-L-w+l,z'j^z ^ 

and for a tunable value 9 (for = 0.9 the iterations are "smooth") 

mi*+^) ^ 0mW + (1 - 0)mi*+^) 

4: For -L - w + 1 < z < -L - 1 let mi*"^^^ ^ m_(/i(*+i)) and for L + 1 < z < 

L + u; - llet ^ ?n+(/i(*+i)). 

5: Continue until t = T such that the distance between the two consecutive 



profiles is less than some prescribed error S. Output h^'^^ (m) and 



m 



(T) 



Figures |3] and H] show the output of this procedure for L = 25, w = 1, 
g{0) = |, 5'(±1) = |. We see from Figure Hlthat when J = 1.1, already for 
w = 1 the continuum approximation equ. fHSl) for the profile is good. 

Table [T] compares the numerical amplitude of the oscillations A'^ for the 
van der Waals curve with the analytical formula (155|) 



3(J-1)^ V VJ-1 



exp -■n^w\ . (72) 



We take J = 1.05, and the triangular window g{\x\) = -^^^{)- — ■'f^)- In order 
to get a stable result for w = 3 we have to go to lengths L = 250. We see 
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h 



(-0.53,0.15) 



. m 



(0.53,-0.15) 

Figure 3: Dotted line: van der Waals curve of single system for J = 1.4. 
Continuous line: van der Waals isotherm for J = 1.4, L = 25, w = 1 and g{0) = ^, 
^(±1) = J. Circles: 40-fold vertical magnification. Throughout the plateau one 
has 50 wiggles corresponding to 50 stable kink states. 









L 




L 




Figure 4: Vertical bars are the numerical values and the continuous lines (blue 
and green) are given by equations (|15]) . (|17|) . Left: kink state centered at m = 



(so h = 0) and J = 1.4, L = 25, w = 1, g{0) = ^, ff(±l) = \- Right: homogeneous 
solution for the same J, L, w, g and h{m) = 0.017. 



that the agreement is quite good for the exponent while the prefactor seems 
to be off by a constant factor 0(1). 

For larger values of J and uniform window (^dxl) = 2w+i 

formula (158|) to compare the numerical amplitude A^^^, with = e ^"'± . 
Table [2] shows the results for J = 1.4 and L = 80. 



Table 1: Amplitude of wiggles: J = 1.05 and triangular window. 



w 












log Af„ 


log^ 












logC™ 


1 


2.5 X 10' 


-12 


2.8 X 10" 


-14 


7.9 X 10^ 


1.09 


1.07 


0.67 


2 


3.4 X 10' 


-22 


9.3 X 10" 


-25 


7.8 X 10^ 


1.07 


1.06 


0.66 


3 


6.7 X 10' 


-32 


5.1 X 10" 


-35 


3.2 X 10^ 


1.05 


1.04 


0.69 


4 


3.2 X 10" 


-41 


3.3 X 10" 


-45 


9.2 X 10^ 


1.02 


1.02 


0.80 
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Table 2: Amplitude of wiggles: J = 1.4 and uniform window. 



w 






Ew 




log 7Vii, 
logSu, 


1 


2.2 X 10' 


-5 


1.7 X 10' 


-4 


1.24 


2 


3.5 X 10' 


-9 


3.0 X 10' 


--8 


1.12 


3 


5.9 X 10^ 


-13 


5.2 X 10^ 


-12 


1.08 


4 


1.0 X 10" 


-16 


9.0 X 10" 


-16 


1.06 



Canonical equations. Let us now discuss the numerical solutions of ([2] 
Here the boundary conditions are not forced at the outset and adjust them- 
selves to non-trivial values when m is on the plateau. It turns out that for 
some values of m the output of iterations is greatly affected by the choice of 
the initial profile. Thus in order to find the correct global minimum of the 
canonical free energy a suitable initial condition must be chosen. A natural 
choice is to choose the solution of (168|) as the initial point. The numerical 
procedure is as follows: 



Algorithm 2 Iterative solutions of f l24l 



1: Fix m. Initialize m^z^ and h^^^ to a solution of (j68|) given by algorithm 1. 
2: From mi*^ compute: 



t+i) 



(J + Z),,,)m-^^| tanh-SnW+ J] ^.,.'"^2^1 

^z=-L z=-Lz>=-L,z'i^z ^ 



3: For — L < z < +L, first update mi^^^ as: 



z'=-L,z'^z 



and for a tunable value 6 (say 6 = 0.9), 

^ + (1 _ 



mi 



4: Continue until t = T such that the ii distance between the two consecutive 



profiles is less than a prescribed error 6. Output /iC^) and 



m 



(T) 



Figure |5] shows the van der Waals curve for J = 1.4 with L = 25, w = 1 
and g{0) = |, 5'(±1) = |. Apart from the usual oscillations on the Maxwell 
plateau we observe that near the extremities (close to ■m±) the curve follows 
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the metastable branch of the single system. This can easily be explained 
from equ. fl53l) . Indeed, the energy difference between a kink and constant 
state {niz = m) is 

(2L + l)$(m±) + Aw{J - ^f'^\l^- (2^ + (73) 

where we drop the exponentially small oscillatory contribution. When |m — 
m±\ is very small this difference becomes positive because of the surface 
tension contribution of the kink, and the constant state is the stable state. 
It is easily seen that this happens for (m — m±Y < 2l+T\/l'('^ ~ l^^"^ As 
seen in fig. [6] this boundary effect vanishes as L grows large. Finally fig. [7] 
displays magnetization profiles: in the bulk they are identical to the grand- 
canonical ones, while near the boundaries the magnetization is reduced since 
the effective ferromagnetic interaction is smaller. 




m 



Figure 5: Dotted line: isotherm of single system for J = 1.4. Continuous line: 
isotherm of coupled model with L = 25, w = 1, g{0) = ^, 5(±) = i. Vertical 
magnification factor in the circle is 40. For \m — m±\ = 0{L~^) there is a boundary 
effect explained in main text. 



h 

(-0.30, 0.02) 




(0.30, -0.02) 



Figure 6: Behavior of the boundary effect for J = 1.1 (same w and g as above) 
and L = 25, 100, 400. 

Random field coupled CW model. The numerical procedures and solu- 
tions are similar to the deterministic model so for simplicity we only consider 
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L 



-L 



Figure 7: Magnetization profiles for J = 1.1, L = 25 (same w and g as above). 
Left: kink centered at m = 0. Right: homogeneous solution for h{nn) = 0.017. 

a grand-canonical formulation with forced boundary conditions for extra ver- 
tices at the two extremities of the chain: 

{^z = XlaPa^anhj Jm^ + h + Ha + Y!^^=~l-w+iD z,^'^^'] ^ -L < z < +L 
TUz = m^{h), L + l<z<L + w— 1 
rriz = m_{h), —L — w + 1 < z < —L — 1, 

(74) 

where m^{h) and m-{h) are the two stable solutions of a RFCW equation 
m = ^qPq ta,iah[Jm+h+Ha} ■ We have implemented the following iterative 
procedure: 

In Figure [8] we illustrate the output /i^"^^ of these iterations for case where 
the random field takes two values H± = ±0.1 with probabilities p± = \- 

h 



(-0.53, 0.15) 




(0.53, -0.15) 



Figure 8: Dotted line: RFCW isotherm for J = 1.4. Continuous line: isotherm 
of coupled model for J = 1.4, L = 2b, w = 1 and ^(0) = ^, ^(±1) = \- In the 
circle: vertical magnification factor is 160. 



6 Anisotropic Kac limits 

In the chain CW models the convergence of the van der Waals free energy 
and isotherm to the Maxwell construction is through a sequence of oscillatory 
curves (see equs (!53|) and (!55|) ). This phenomenon is intimately related to the 
fact that the reference model that gets coupled is mean field. This may be a 
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Algorithm 3 Iterative solution of fTMj) 



1: Fix m. Initialize rri^z^ = m for —L < z < L and h^^^ = 0. 
2: Update h^^~^^^ ^ X where X is the (unique) solution of: 



^ L L+w-l 
-— Y,Y.P^ tanh{ JmW + X + + ^ D,^,,m^^) } = m. 



2L + _ 

z=—L a z'=—L~w+l 

3: For —L < z < +L, update mi*^^^ as: 



J + D 



tanh{ JmW + h^'+^^ +H^+ Yl } [ • 



L+w-l 



and then: mi*"^^^ ^ Orni^ + (1 — 6)rn'z~^^'' (for a tunable 0). 
4: For -L - w + 1 < z < -L - 1 let mi*"^^^ ^ m_(/i(*+^)) and for L + 1 < z < 

L + u; - 1 let mi*+^^ ^ ?n+(/i(*+i)). 
5: Continue until t = T s.t the li distance between two consecutive profiles is 



less than a prescribed error 5. Output h^'^^ and 



m 



(T) 
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complete graph model or a sparse graph model; it has to be, in some sense, 
an infinite dimensional system (see section [7]). The oscillatory behavior is 
not found in anisotropic Kac limits of finite dimensional models. This can 
be understood very easily from the following arguments. 

Suppose one considers a 2-dimensional Ising model on a rectangular lat- 
tice of dimensions (2L-I-1) x A^. Let (rg, ri) be the vertices with tq G —L, L 
the longitudinal component and ri G 1, the transverse component. Con- 
sider the spin-spin interaction 

Xiw//iro - rQ),W±{ri - r[))s^ror^)S{r',^r[) (75) 

W±W// 

where xi^o^^i) = 1 for kol ^ ki| ^ 1 and otherwise. We consider the 
anisotropic case w± » w// were a spin couples to many more spins along 
the transverse direction than in the longitudinal one. Note that for w± = N 
one recovers a coupled chain CW model and the transverse direction becomes 
effectively infinite dimensional. Our interest here is for w± » w// both of 
0(1) with respect to and L. One can consider two types of anisotropic 
Kac limits, namely 

limlimlimlim and limlimlimlim (76) 

w// w±_ L N w 1 1 L w± N 

where it is understood that all parameters tend to -|-oo. In both cases the 
first limit limTv can be thought of, as the thermodynamic limit of a quasi- 1- 
dimensional strip of fixed width 2L + 1. Let fN,L{fn) be the canonical free 
energy per spin of this quasi- 1-dimensional model. Since the interaction is 
finite range we know by general principles that lim7v->+oo /a^.l is a convex 
function of m for any fixed L, w±, w//. Since the limits of convex functions 
are convex (when they exist) both remaining limiting processes will happen 
through a sequence of convex functions with no oscillatory behavior. Likewise 
the van der Waals curve of the anisotropic model will in both cases converge 
to the Maxwell plateau but only through a sequence of increasing functions 
with no oscillations. 

The same discussion applies to a c? + 1 dimensional model on a box of size 
(2L + 1) X A^"^. But one can also consider the following variation: instead 
of w± —7- +00 take d — )■ +oo. When d — > +oo is done after N ^ oo there 
will be no oscillatory behavior. On te other hand when d — +oo is done 
before A^ — ?■ oo, then the transverse direction effectively becomes a Bethe 
lattice and we get a coupled chain of mean field systems which will display 
an oscillatory behavior. 
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7 Conclusion 



We introduced the present model as a "toy model" to understand the thresh- 
old saturation phenomenon that is at the root of the excellent performance 
of recent constructions in the field of error correcting codes for noisy channel 
communication. As mentioned briefly in the introduction the same phe- 
nomenon occurs in a wide variety of spatially coupled systems such as con- 
straint satisfaction problems, compressed sensing and multi-user communi- 
cation systems. 

Let us say a few words about the chains of constraint satisfaction problems 
[S], These include K-satisfiability, XOR-SAT, Q-coloring on Erdoes- 

Renyi graphs. The mean field solution of these systems (for the uncoupled 
system) is obtained by the cavity or replica methods [28]. This solution is 
also closely related to message passing algorithms such as belief and/or sur- 
vey propagation which predict the existence of a region in the phase diagram 
with exponentially many metastable states between two thresholds: the "sur- 
vey propagation" threshold and the SAT-UNSAT phase transition threshold. 
By analyzing the cavity equations, for the coupled models with appropriate 
boundary conditions, we discover that, as the range of the Kac interaction 
grows, the survey propagation threshold saturates towards the SAT-UNSAT 
threshold. This fact may have important algorithmic consequences that re- 
main to be investigated. 

What is the generic picture that emerges ? All systems considered above 
are coupled chains of individual infinite dimensional systems or mean field 
systems. Indeed the individual systems are defined on sparse graphs or com- 
plete graphs, which are both, in some sense, infinite dimensional objects. 
Besides, their exact (or conjecturally exact) solutions are given by mean 
field equations (Curie- Weiss equation, cavity/replica equations ect...). These 
equations (for the individual system) have two stable fixed point solutions 
which describe the order parameter of the equilibrium states for the indi- 
vidual system. When boundary conditions are fixed such that the order 
parameter takes the two equilibrium values at the ends of the chain, the spa- 
tially coupled system has a series of new equilibrium states corresponding 
to kink profiles. Since the kink interface is well localized its free energy is 
close to a convex combination of the two free energies corresponding to the 
boundary conditions. Because of the discrete nature of the chain there are 
tiny free energy barriers corresponding to unstable positions for the kinks 
in-between two positions on the chain. This is the origin of the wiggles, both 
in the free energy functional (of CW or Landau or Bethe type) and in the 
van der Waals like curves. A somewhat related discussion can also be found 
in [30]. Let us note that this picture is exactly confirmed by an analysis of 
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the weight enumerator and growth rate for the number of codewords of given 
relative weight of spatially coupled LDPC codes [27]. 

It seems that the threshold saturation phenomenon should be quite generic 
among all oo + 1 dimensional systems which support kink-like equilibrium 
states. There are many open questions that are worth investigating. For ex- 
ample, connections to coupled map systems, discrete soliton equations and 
the stability of their solutions, would allow to better understand when the 
phenomenon occurs or does not. Also the algorithmic implications of the 
phenomenon of threshold saturation is a largely open issue. 



8 Appendix 



We give the main steps leading to formulas ( 152|) and (l53l) . First we notice 
that 



F{k)= dze'^'^'F{z) =e V^(^ cize™G(z) (77) 

J — oo J —oo 

with 

Giz) = -2 E DzAm>l, - ml) + $(m°) - ^^MT^)) (78) 

z'=—oo 

and m° is a kink centered at the origin. 



m° = V3(J- l)tanh|^y ^^^zj. (79) 

Now we evaluate the sum over z' in the first term of f lTHj) . Setting z' = wx' 
we have for w very large, 

E /^.ym°, = :^^^SHlI V {g{\---\)-w6. .Otanh|./^^\ 
^ ' ^ w ^ ^^'w w^' [V Ik w] 

— — rvo — — rvi ^ ^ 



z'=—oo z'=—oo 

hoo 



JJ3(J-1) I dx'(g(\x'\)-5(x'))tanhlJ- — -(x + -] 

2k w 



jV3(J3T).„=i^tanh{iyHi,| (80) 



Therefore 

+ 00 



z'=—oo 

(81) 
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In a similar way one shows that the — term does not contribute, and one 
finds 



+ 4(y3p^tanh{i,/:^4) - 4.(73(7^) 

XV V 

Replacing in fl77|) we get after a scaling, 



^2) 



F{k) = w\j- — -e V^iJ^ 



+00 



dze 



G{z) 



(83) 



where 



G{z) f«-J(J- 1)2(1 -tanh^ z) tanh^z 

+ <l>(v/3(J- l)tanh^) - <l>(v/3(J- 1)) 



^4) 



As a function of 2; G C, G'(z) is analytic in the open strip |9'(-2)| < f . 



Indeed tanh^; has poles at z„ 



[n 



h)i7i, n E 1j and $ has branch cuts for 



v/3(J- l)tanh z g] — 00, —1] U [1, +oo[, or equivalently on the intervals 



Zn, Zn - -sign(ra) In 



1 + v/3(J-l) 



1- 



^5) 



It is easy to see that the integrand in (l83i) tends to zero exponentially fast, 
as -R — > +00, for z = ±R + iusign{k), \u\ < ^ — 6 (any < 5 < 1). Therefore 
we can shift the integration over M to the line z = t + i(| — 5)sign(/c), t G M, 
which yields. 



F{k) =w 



2 k 27rifc^^ 



J -I 



dte'^'*'"y—^G{t + i(- - (5)sign(A;)) 
2 



|G(t + zsignA;(^ - 5))| < C{J - 1) V'^'r^ 
Since 5 can be taken as small as we wish, this allows to conclude that 



^6) 



From expression (18^ it is possible to show the estimate (for | J — 1 1 < < 1 
and < 5 << 1 and C a numerical constant) 



(87) 



F{h) = Cs,jAk)5-\J - lf''wV2^e V^e-^'^^'^Vrf^-i--^^) (88) 
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where Cs^j{k) < C for all k. This result implies that the Van der Waals 
curve has oscillations, around the Maxwell plateau, of period ^^^^ and 



-ui,/-^7r2 



amplitude e^'V 7^' . 

By replacing the first terms of the expansion of $ when J — )■ 1+. we can 
obtain a completely explicit approximation for F{k). Thanks to the exact 
formula 

dze'^\l - tanh^ z) = ![Miz^ (gg) 
oo 6 sinh ^ 

and using $(m) ^ —^^^rn? + j^Tn^ we get 

G(^) ~ ^(J- 1)'(1 -tanh^^), (90) 
we find asymptotically for w large, J — > 1+ and any fixed k 



F{k) ^ 4(J - l)Kti;VA;(l - A;^^^) sinh"! (^kir'w^^^^ . (91) 
This is formula ( 152|) of the main text. For the zero mode k = we get 

F{0)^A{J-ir/'w^ (92) 
and for the other ones /c G Z* 

F(A;) ^ -8(7ru;)V|A;|Vl^l" "'V^e v^^t^ (93) 



Finally, for the reader's convenience, we point out that to check f l89 
one can use |(tanh2;)'" + |(tanh2;)' = 1 — tanh^^; and dze^''^ taiah. z = 
i7r(sinh^)-i [3l]. 
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